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ABSTRACT 

Represent  a  t law- •he red  computer  system  as  a  group  of  N  terminals,  each 
having  submission  rate  \  and  exponential  (y)  task  durations,  with  tasks  sub¬ 
mitted  to  a  central  (single)  processor.  There  they  are  serviced  in  processor- 
sharing  or  time-sliced  mode.  It  is  shown  that  the  R(t),  the  response  time 
conditional  on  t  ,  the  required  processing  time,  becomes  approximately  normally 
diatrlbuted  as  t  Increases.  Similar  results  are  derived  when  N  increases. 

Variations  of  the  model  consider  control:  an  "inside,"  processor-shared 
queue  services  at  most  c  tasks,  others  queueing  first-come  first-served 
"outside.”  Other  possibilities  arc  described  and  analyzed. 

1.  Introduction 


The  abstraction  of  computer  capacity  allocation  known  as  processor  sharing 
is  an  attractive  simplification  of  time  slicing,  sometimes  called  round-robin 
scheduling.  The  idea  is  well  known  (Klelnrock,  1976):  given  that  j  Jobs  or 
programs  are  at  the  execution  stage,  each  receives  service  equal  to  one-Jth  of  a 
tine  unit  per  time  unit.  In  other  vords,  if  the  chance  that  any  single  job, 
processed  alone,  finishes  in  (t,t+h)  is  ,;h-*o(h),  (exponentlal-Markov 
service),  then  the  chance  that  a  particular  ("tagged")  job  in  the  company  of 
(J-l)  others  finishes  in  (t,t+h)  is  u(h/j)+o(h)  as  h  0.  Processor 
sharing  of  the  above  type  tends  to  ba  equitable  in  that  it  permits  short  jobs 
access  to  procsssing  even  if  they  arrive  after,  end  queue  with,  longer  Jobs. 

Apparently  the  first  study  of  delays  to  arriving  and  queueing  jobs  under 
processor  sharing  was  conducted  by  Coffman,  Muntz,  and  Trotter  (1970).  They 
assumed  s  steady  state  M/M/1  system  with  processor  sharing,  and  were  able  to 
determine  properties  of  the  response  time,  R  ,  given  the  processing  time 
required  by  the  arriving  job.  Other  papers  have  also  appeared. 
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A  recent  paper  by  D.  Nitre  (1981)  analyzes  response  tine,  R  ,  under  the 
assumption  of  a  dosed  systea.  Idealize  the  behavior  of  a  systea  of  N  terat¬ 
osis  end  a  single  coaputer  as  a  classical  machine-repair  situation:  each  think¬ 
ing  terminal  (failure-prone  aechine)  applies  for  coaputer  service  st  rate  1  , 
and  queued  or  waiting  Jobs  are  served  at  rate  u  as  long  as  any  jobs  are 
present.  Harkov  assuaptloos  are  aade  throughout,  so  X(t)  ,  the  number  of  jobs 
at  the  service  stage,  is  a  birth  and  death  process  with  transition  rates 


X(t)  •  J  -  X(t4h)  -  j  ♦  1  :  Xjh  ♦  o(h)  (1.1) 

■*  X(t*H»)  -  j  -  1  :  Ujh  ♦  o(h) 

X(t+h)  -  j  :  1  -  (Xj+Vjlh  ♦  o(h) 

and  in  particular  1.  •  A(N-J),  u.  -  u  for  J  >  1  ,  otherwise  being  zero.  Let 
processor  sharing  govern  service  effort  allocation.  In  Nltra  (1981)  the  dis¬ 
tribution  of  response  tine  is  characterized,  and  the  aoaents  (e.g.  mean  and 
variance)  are  found  under  Interesting  conditions,  such  as  that  the  lagged  job 
requiring  t  tine  units  of  processing  arrives  to  find  J  -  1  accompanying  jobs; 
the  conditional  response  tine,  given  only  processing  requirement  t  ,  is  given 
particular  attention. 

In  this  paper  the  previous  analysis  is  generalized  and  extended.  We  intro¬ 
duce  the  idea  of  processor  sharing  in  an  arbitrary  birth  and  death  process  en¬ 
vironment,  thus  allowing  quite  general  terminal-computer  interactions  to  be 
represented.  In  the  process,  the  meaning  of  "system  state  at  the  moment  of  tag¬ 
ged  Job  arrival**  is  clarified;  see  also  recent  work  of  Lavenberg  and  Reiser 
(1981).  Response  time  characteristics  are  computed  under  the  assumption  that 
processor-sharing  service  rates  are  processor-stat e-dependent  in  a  more  general 
way  than  that  described  earlier;  this  allows  for  approximate  representation  of 
overhead  penalties  and  also  of  job  scheduling.  Other  characteristics  of  tagged 
Job  response  are  also  studied,  e.g.  the  accumulated  processing  work,  u(t)  , 
actually  performed  on  that  job  by  elapsed  time  t(t  <  t  •  required  processing 
time)  following  Job  introduction;  note  that  W(R)  ■  t  ,  so  the  first  passage  of 
V(i)  to  t  is  actually  the  response  time. 

Although  differential  equations  may  be  obtained  for  transforms  of  U(i) 
under  various  initial  conditions,  and  hence,  implicitly,  for  its  distribution, 
the  results  are  far  from  being  explicit  and  informative.  However,  central  limit 
theorems  for  additive  functionals  of  Harkov  processes,  or  for  cumulative  pro¬ 
cesses,  allow  the  conclusion  that  the  accumulated  work  accomplished  by  fixed 
time  t  on  e  "long"  job  is  approximately  normally  distributed  (Caussian).  This 
fact  in  turn  allows  the  conclusion  that  the  response  time  for  a  "long"  job  Is 
also  approxiSMtely  normally  distributed.  Additionally,  the  normal  approximation 
may  be  shown  to  be  valid  for  our  simple  model — and  probably  for  others  as  well — 
when  the  number  of  competing  terminals  becomes  large,  i.e.  under  heavy  traffic 
conditions.  The  quality  of  the  normal  approximations  for  finite  job  lengths  is 
currently  being  assessed  by  simulation  methods. 

In  the  latter  part  of  this  paper  we  describe  queue  control  in  s  processor¬ 
sharing  environment.  The  expedient  is  to  limit  the  total  number  of  jobs  allowed 
simultaneous  processor-shared  service  at  an  "inside"  queue,  with  any  excess  in 
"first-come,  first-served”  status  In  an  "outside"  queue.  Long  jobs  are  also 
shifted  from  inside  to  outside  by  s  sampling  mechanism.  It  is  shown  that  long 
jobs  are  favored  by  a  small  inside  span,  c  (c  being  the  number  simultaneously 
processor-shared),  while  short  jobs  are  favored  by  large  c  . 


■•fie  by  describing  differencial  aquae  Iona  for  Che  mu  response  Cine  to  be 
operienccd  by  a  cogged,  particular,  arriving  job.  Ocher  amenta  satisfy  very 
slallar  equations. 

(a)  Conditioning  on  Required  Tins  and  Systea  State. 

Throughout  what  follow  Markovian  assuspeions  are  node:  service  tines 
at  Che  cooputer  are  independent  and  esponencial  (u) .  Generalisations  to  phase- 
type  distributions  are  apparently  possible. 

Let  ft  refer  to  the  response  cine  of  e  newly  arrived  Job,  end 


•jCt)  •  tf«|ftCO)  •  J.  Iff*)  -  t)  ,  (2.1) 


the  conditional  sspectatlon  of  reeponso  time,  given  that  the  Job  is  initially  in 
the  company  of  J  others  (arrives  to  find  J  -  1  present)  and  requires  MworkM 
or  processing  tine  equal  to  t  .  Let  i,h  (reap,  w  h)  for  small  h  Identify 
the  inf Inltcsinal  generator  of  the  accompanying  process,  so  transition  rates  are 
as  in  (1.1). 


Consider  the  possible  system  changes  In  (O.h), 
following  results  occur:  ^let  •u(J-i)  : 


end  subsequently;  the 


njU)  *  h  ♦  mjd  -  *  hMl  -  (»J*sJ)h| 


♦  l^ha^d  “  •  h)  ♦  S’  hn  j(t-  ^  •  h)  ♦  o(h)  . 


(2.2) 


the  tern  r(j)  represents  the  tract  ton  nl  t Imp  the  processor  actually  spends 
processing  when  there  are  j  lobs  being  processed. 

Allowing  h  -  0  one  finds  the  differential  equations 


Util 

i 


■j’U)  •  1 


(2.1) 


This  Is  a  standard  systea  of  linear  differential  equations  with  constant  co¬ 
efficients;  initial  conditions  srs  a^fO)  •  0  for  all  J  . 

(b)  Conditioning  n  Required  Tlae. 

If  one  reaoves  the  condition  that  X(0)  •  J  in  accordance  with  the 
stationary  distribution  appropriate  for  an  arriving  job  it  follows  that  the 
espected  response  tiae  is  linear  in  the  required  processing  tias,  t  .  This 
holds  for  quits  general  birtb-ar*d -death  process  aodels,  snd  not  just  for  the 
staple  machine-repair  setup;  see  Cohen  (1979).  Here  is  the  derivation.  In 
outline. 

first,  observe  that  the  long-run  distribution  of  X(0)  ,  the  ouaber 
present  Just  after  the  tagged  job  enters,  is 


of  Jobs 


tj  • 


<*.4> 


J  *  1»2,...»M  • 


C  il  Selected  H  Clue  CtM  C  '•  Ml  CO  CM.  ball  Clut 

I.  •  i.  '  *  J"*  !•  th«  stationary  Uurtbutleo  (uiucd  to  edit)  of  the 

J  0 

Markov  chela  X(c)  4* fined  by  (1.1)  with  u.  •  »r(|)  .  Thla  is  intuitively 
spy  rent,  but  a  formal  proof  cao  bo  based  either  upon  an  embedded  HirVov  chain 
formulation,  or  upon  the  theory  of  additive  functionals  of  a  Markov  process; 
see  flnlar  ((1971),  pp.  249-271).  The  distribution  (^)  has  also  boon  (Ivon 

by  Kelly.  (1979).  p.  12. 


Mso  (2.4)  to 


the  condition  that  X(0)  •  J;  put 


•(C)  *  E,(0)U*[X(0).  W(«>  .  t)  * 


(2.5) 


Then  In  terns  of  the  differential  equations  (2.2);  after  aultiplying  through  by 
J/r(J)  one  obtains  (n^(t)  i  0) 

*'(,>  •  jl,  j£»  ’j  *  J,  ’j?oJ  '•  «,*  »j>V’  *  ‘j*j.i<0 
*  jf,  tAt  'j  • 

Thus  ic  follows  that  the  loot-run  conditional  expected  response  time  is  linear 
in  the  processing  tins  requirement: 


t(K|V(K) 


t)  •  * 


I 

i-1 


*U>  *1 


“IrlKOnJ  * 


(2.7) 


Apparently  no  such  staple  fora  exist*  for  fsr{R|lf(ft)  *  t)  ,  although 
Mitre  (1941)  has  given  e  formula  for  a  particular  case.  It  will  he  seen, 
however,  that  the  above  variance  is  indeed  proportional  to  t  if  t  is  large. 


J.  Total  Herb  Completed  on  a  Tatxed  Job  ia  a  fixed  Tims 

Torn  attention  now  to  V(t)  ,  the  tots!  work  expended  by  the  computer  on 
the  tagged  job  by  tine  t  after  its  arrival,  given  that  the  tagged  job  requites 
exactly  t  tine- waits  of  work  for  conpletlon.  If  when  the  job  arrives  there 
are  2(0)  •  J  cwstoonrs  present,  then 


I<0>  •  J  >  l 


0.1) 


K<t)  * 


(a)  Tbe  Laplace  transform  of  U(t). 

Sara  la  tbe  dart vat  loo  of  a  differencial  aquation  for  the  Laplace 
transform  of  M(i)i 

♦jte.m)  .  I|a*l4,(l>|«<0)  •  J,  «  •  t|  .  for  J  >  1  0.2) 

How  argue  la  a  aanmr  analogous  to  the  disc  was  toe  prior  to  (2.2)  to  write  a 
backward  equation:  (or  0  «  h  *  t 

♦j(e,t;t)  *  Ce“*r(J)h,i)U-(lj*u'J)h|ffj(»,t-h;t) 

♦  <#*ar(|)Wj)Jk  M  ^  (a,i-h;» )  0.1) 

♦  <«“*r<J)l,/,)eJH#J,l  (s.t-b;t)  ♦  o(h)  . 


landing  to 


*♦« 

-jf  *  -  Oj  ♦  s.j  ♦  »r(J)/j)tj  ♦  ♦  n  #  4  .  (1.*) 


Initial  condlttooa  are 


♦jCa,0;t)  -  l(e’*Mf0)j«(O)  *  J,  It  *  tj  •  1  ,  t  >  0  ,  (3.5) 


alnca  Initially  W(0)  •  0  ,  regardlesa  of  the  Job  requirement*  or  the  initial 

eaelrenaant. 

(h)  A  central  limit  theorem  for  «(t). 

Cased  nation  of  (1.1)  shown  that  V(t)  involves  sums  of  contributions 
to  work  accumulated  while  the  eyntcm  inhabits  various  states  during  the  period 
(0,t).  This  suggests  that,  at  least  for  "long"  jobs,  i.e.  such  that  required 
processing  time  t  -*  •  ,  one  can  anticipate  a  neariy-Horael  distribution  for 
V(t)  .  An  appropriate  central  Unit  theoren  that  establishes  this  for  finite 
hlrth  and  death  models  can  be  found  in  Kellnon  ((1979),  p,  121);  call  thin 
Theoren  K.  Alternatively,  one  can  naka  use  of  the  theory  of  cumulative  pro¬ 
teoses,  see  Cox  ((1962),  pp.  99-101);  the  latter  development  is  adaptable  to 
models  more  general  than  the  simple  birth-and-death  process. 
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la  order  to  apply  Tkaorw  K  radeUaa  die  lafUlteitaal  generator  (1.1)  to 
dancrlbe  the  behavior  of  the  accoopanlnent.  X* (t)  ,  of  the  tagged  cuatoaer;  note 
that  the  relev aat  generator  i»  now 


I'(t)  •  J  *  I‘(t*b)  •  J  ♦  1  t  ljh  ♦  ©(h) 

i  lJ4lh  ♦  o(h) 

*'<td»)  •  J  -  I  :  vjh  *  o(h) 

!  Vi  (  A)1’  * 

X'Ctah)  *  j  t  l-(ij  *  v*)h  ♦  o(h) 
for  J  •  0,1,2 .  8*  *  U  •  1  .  Then 


« 

«(t)  *  /  f (X* (u))du 
0 


/ 


0 


r(X*(v>*f 

X'Cv)  *  1 


and  theore*  K  iiaiai  that 


0.6) 

0.7) 

0.8) 


0.9) 


the  constants  ' 


YS'l'J,' 

pfi 


8(0,1)  ; 


c*  ere  with  that 


0.10) 


*• 

*  *  I  *(jk 

J*0  J 


9*  *  2|f (0),f (1) . f(8*)) 

['i  .1 

f(0)  ' 

•i 

l 

f(l) 

o 

o 

^  M 

o 

• 

f (»’)  . 

0.11) 

0.12) 


where  la  the  present  ease  the  definition  of  f(»)  fa  Inplicit  in  (J.9),  and 
X  la  the  netria 


*•  *«Hwtrl  -  v 


0.0) 


6 


4,  b«ln|  the  identity,  end 


■o 


V 


*1  ••• 


»;  ••• 


(3.14) 


j^-rowe  are  steady-state  probabilities  for  the  accoapaninent,  and  ^  is  defined 
aa  follows: 


*0,1  "  •  Ao,0  "  1  "  Xbh 


‘  lj/Y  •  '  "j/T  •  aj.j  * 1  ■  VT 


(3.15) 


Vj  “j  *  “i  ‘  ‘  V 


‘*0  ■  »;■  v  *  -;•> 


(c)  A  central  limit  theorea  for  response  time,  R(t). 

A  graph  of  W(;}  vs,  t  starts  with  W(0)  *  0  and  increases  in 
randoa  straight-line  segments  until  W(t)  -  t.  The  value  of  t  at  which  this 
occurs,  t(t)  £  R(t),  la  the  first-passage  tine  to  t  of  the  work  process 
(V(t),  t>0)  ,  and  is  the  required  response  time,  so 


F{W(t)<t)  -  P(R(t)>t )  . 


(3.16) 


Row  invoke  the  previous  theorea  (3.10)  concerning  asymptotic  normality  of  W(t) 
and  a  standard  argument  of  renewal  theory,  cf.  Karlin  and  Taylor  ((1979), 
pp.  20A- 209)  to  see  that  if  t  •  It  ♦  /oatx  ,  then,  as  t  ■*  »  , 


t 


froa  which  it  follows  that 


»(-Q  -  at  £  R(t)  -  t/C  (DJ 


N(0,1)  . 


(3.17) 


4.  j£!£EL  *mly»U  of  the  toiponit  Tl—  of  i  Processor- Shared  Job 

This  section  investigates  the  problem  of  delay  of  a  tagged  job  requiring 
t  unit*  of  processing  time  when  It  is  accompanied  by  many  others,  i.e.  la  In  a 
heavily  loaded  syataa.  Restrict  attention  to  the  machine  repair  aodei  in  which 
X.  •  X(M-J)  and  p.  •  u  .  and  omit  the  effect  of  r(j),  l.e.  r(j)  s  1  .  Let 

•  •  eel 

there  he  M  terminals  and  one  processor,  with  X  being  the  expected  terminal 
think  tine  (exponentially  distributed),  p  •  Up'  being  the  processing  rate  of 
arriving  jobs;  X  and  p’  are  fixed  but  N  Is  large  and  the  service  rate 
scaling  by  N  is  required  In  order  that  queue  else  be  of  order  N  . 

Mow  utilise  the  fact  (lglehart  (1965),  and  Caver  and  Lehoccky  (1976))  that 
if  X(t)  is  the  number  of  jobs  at  the  processing  stage  at  t  then  X(t)  can 
be  approximated  by  a  diffusion  process: 


X(t)  ■  M  a(t)  +  Y  (t)  (4.1) 


where  a(t)  la  a  deterministic  function  of  time  and  (y(t)}  is,  for  the 
present  model,  a  particular  Ornsteln-Uhlenbeck  process.  It  turns  out  that  when 

M  • 


-  i(l-a(t)) 


or 


a(-)  -  1 


nl 


(4.2) 


(4.3) 


which  is  feasible  if  X  >  p'  ,  i.e.  under  heavy  traffic  conditions.  Furthermore 


dY(t)  -  -  XY(t)dt  ♦  /X(l-a(t) )  ♦  p*  dB(t)  ,  (4.4) 


{B(t),t  _>  0)  being  the  standard  Wiener  process.  In  the  long  run. 


dy(t)  -  -  XvU)dt  ♦  Sh?  dB(t)  .  (4.5) 


It  is  In  the  environment  X(t)  described  by  (4.1)  that  the  tagged  Job  enters. 
It  encounters  competition  for  processor-shared  service,  and  so  its  accumulated 
work  completed  by  fixed  time  t  is  essentially 


t 

W(t)  -  / 


0 


du 

*X(u>  ’ 


(4.6) 


Apply  Che  approximation  and  expand  to  second  order  terms  in  N  ,  the  number  of 
terminals,  to  find 


* 


I 


WCt)  * 


t 


i 


Ha(u) 


nsn 

a(u)^ij 


/  du  _  /j  V  (u)du 
0  0  (Na(u))2 


(*.?) 


For  simplicity,  and  to  taabli  comparisons  with  previous  results,  let 

a(v)  •  «(•)  ,  so  tbs  tagged  job  arrives  in  the  steady  state.  Expression  (1.6) 

Chan  says  that  for  the  approximation  advanced  here. 


*  du  JS 

l  lUMl  ■  (EIX(-)J)^ 


T 


/ 

0 


Y(u)du  , 


0  <  T  <  t 


(4.«) 


so  the  expected  amount  of  work  dona  on  the  tagged  job  is  nearly  t/E(E(«*))  , 
sod  the  actual  distribution  of  total  work  dona  is  approximately  Causa lan 
(integral  of  an  Oraateln-Uhlenbeck  process),  where  the  Gaussian  property  results 
from  the  assunptlon  of  nany  accoapaaylng  Jobs,  and  not  necessarily  because  the 
tagged  job  la  long. 

Standard  calculations  applied  to  (1.7)  show  chat,  aa  t  ♦  •  , 
t  t 

K( /  Y(u)du)  *  0  and  ?ar| /  Y(u)du)  *  (2w'/X2)t  ,  ao  the  normal  approxlnatlon  to 
0  0 
accumulated  work  W(t)  has  the  parameters 


C  - 


iSa(-) ] 


»  .  2y 

I«a(-))-  X7(lU(-)  J" 


(♦.9) 


Iron  which  It  follows  that  the  paraneters  of  the  normal  approximation  to  K(t) 
are 


a  -  -  lMa(->]  m  E[x(«)] 

at  -  H  — *  a  ft*  ,  1  _  -  2  {S  -  I1XW1, 
r  I*  Se(-)  *  F  t[X(-)j  X  1  «tf(-)J  ' 


(1.10) 


These  formulas  state  that  If  think  (demand)  rate  X  is  very  large  then,  since 
SlX(*)}  ■»  I  ,  the  variance  of  reapoose  time  diminishes,  while  of  course  expected 
response  tine  increases  like  I  .  This  is  plausible  since  in  extremely  heavy 

traffic  all  terminals  coepete,  and  the  tagged  job  gets  a  steady  (1/X)—  of  a 
fnaatiai.  For  samller  X  the  expected  response  tine  drops  with  E(X(»)J  ,  but 
response  time  variance  increases. 

The  above  derivations  are  Informative  but  not  rigorous.  Semigroup  methods 
ef  Berman  (1979)  can  be  applied  to  place  the  results  on  a  mathematically  solid 
basis,  numerical  assessment  of  the  results  is  also  of  Interest. 
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S.  Bumarlcal  Comgariaona 

i 

la  this  •action  a  brief  investigation  Is  reported  of  the  numerical  agree- 
aaat  batveen  the  very  simple  formulas  from  heavy  traffic  theory  for  the  param¬ 
eters  of  the  accumulated  work  distribution  and  those  of  direct  Markov-chatn 
cumulative  process  theory  origin. 


tSL  ameters  of  Total  Work 


Kxaaoles.  lee 

M  •  1. 

V  •  25,  50,  with 

B  - 

X  varying. 

23 

Be test A) : 

0.01 

0.0222... 

0.05 

0.10 

0.15 

C(M.Ch.) 

0.77 

0.51 

0.16 

0.067 

.055 

(niff us.) 

— 

— 

0.20 

0.067 

0.055 

•*(M.Ch.) 

0.44 

0.75 

0.22 

.0045 

0.00065 

(Mffue.) 

— 

— 

1.28 

.0040 

0.00079 

■  -  50 


Bates (X): 

0.01 

0.0222... 

0.05 

0.10 

0.15 

COLCh.) 

0.33 

0.13 

0.033 

0.025 

0.023 

(Stiff  us.) 

— 

0.20 

0.033 

0.025 

0.023 

•*  01.01.) 

0.83 

0.33 

0.0011 

0.000081 

0.000026 

(Dtfffus.) 

— 

6.48 

0.00099 

0.000078 

0.000025 

The  diffusion  approximation  and  Markov  chain  parameters  agree  remarkably 
moll  when  traffic  la  heavy  (large  X),  but,  as  night  be  feared,  diffusion  falls 
miserably  for  small  X  . 


1.  Qnaua  Control  by  Sarvlca  Span  and  Interruption 

la  this  section  ve  consider  queue  control.  The  central  processor  now  has 
flalta  sarvlce  span,  c  ,  which  may  be  smaller  than  Che  number,  N  ,  of  ter- 
•alaala.  This  means  that  if  there  are  1  <  c  jobs  in  service  they  are  served 
as  before  "Inside"  at  a  rata  prd)  ,  with  processor  sharing  in  effect.  How¬ 
ever,  if  there  are  more  than  c  jobs  simultaneously  requesting  service,  only 
c  of  them  are  served  simultaneously,  and  at  rate  ur(c)  ,  also  with  processor 
sharing  discipline.  The  others  are  queued  "outside",  with  "flrat-comc,  first- 
served"  service  discipline. 
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It  there  ire  more  than  e  customer*  requesting  service,  the  customers  that 
ere  in  service  "Inside"  experience  Independent  service  Interruptions  st  rate 


Uhen  service  Is  Interrupted,  each  job  In  service  la  equally  likely  to  be  moved 
to  the  end  of  the  queue;  thereupon  the  job  at  the  head  of  the  "outside"  queue 
immediately  enters  service.  Both  the  Imposition  ol  the  United  processor 
•haring.  Imposed  by  c  <_  N  ,  and  the  Interruption  process  are  intended  to  control 
queueing  by  adjusting  the  relative  attention  given  to  short  and  long  jobs. 

Markovian  assumptions  are  nsde  throughout,  so  that  X(t)  ,  the  number  of 
Jobs  requesting  service  at  time  t  ,  Is  a  birth  and  death  process  with  transi¬ 
tion  rates  glvon  by  (1.1). 

(a)  An  Auxiliary  Process. 

Let  X  be  the  response  time  of  a  newly  arrived  tagged  job.  Since  the 
tagged  Job  may  not  be  servod  until  completion  when  It  first  enters  service.  It 
la  necessary  to  introduce  an  auxiliary  process  (Y(t);  t  >  0)  In  order  to  study 

K  . 


In  brief  summary.  If  there  are  1  customers  (Including  the  tagged  job)  re¬ 
questing  service  at  time  t  and  the  tagged  job  Is  in  service,  then  the  state  of 
T(t)  Is  (1,0)  .  If  there  are  1  >  c  customers  requesting  service  at  time  t 
end  the  tagged  job  is  not  in  service  but  Is  In  the  Jth  position  in  queue,  the 
state  of  Y(t)  is  (1,J)  .  One  can  now  describe  the  possible  changes  In  Y(t) 
in  a  time  Interval  of  length  h  ;  details  will  be  presented  elsewhere. 


•<i.J)' 


El*  |Y(0)  -  (i,J) 


(6.1) 


the  conditional  expected  response  time,  given  that  the  tagged  job  Is  initially 
in  the  company  of  (1-1)  others  and  either  it  is  being  served  inside 
(If  J  *  0)  or  It  is  Jth  in  the  outside  queue  (if  J  >  0)  . 


*rg  uments  similar  to  those  of  Section  2  yield  differential  equations  for 
"(1  j)^  which  can  be  solved  numerically.  A  closed-fora  solution  is  compli¬ 
cated  and  uninformative.  It  is  possible  to  numerically  evaluate  the  mean 
reeponse  time. 


.(,)  -  eir|w(r)  -  t)  -  I  1(liJ)-(1J)<t> 


where 


'(i.j) 


is  the  Initial  distribution  encountered  by  the  tagged  job. 


The  mean  response  time  Is  not  generally  linear  in  t  for  this  model.  Note 
that  If  c  *  N  then  this  model  is  equivalent  to  that  considered  In  Section  2 
and  hence  as  shown  Is  Section  2,  m(t)  i_s  linear  in  t  for  that  special  case. 

(b)  An  Approximation  to  Expected  Response  Time. 

A  u flttl  approximation  to  the  expected  response  time  for  a  job  requir¬ 
ing  t  units  of  work  Is  obtslned  by  the  following  argument.  Assume  that  the 
service  rate  for  the  tagged  job  is  the  same  throughout  its  processing  and  Is 
equal  to  the  rate  that  It  experiences  when  it  first  enters  the  processor.  Thus 


w 


eh*  tMggmd  job  roqulros  t*  -  uni  to  of  procttoln*  timm  it  it  oators  when 

*^M*  **'  1  i  *  J°6*  (including  the  tagged  one)  requesting  processing.  If 

1  >  e  »  then  t*  •  •  If  1  >  c  ,  then  the  number  of  aervlce  Interruptions 

*  I*  folnnon  with  rate  ~  •  Bach  time  service  Is  Interrupted,  the 

tagged  job  spends  an  expected  amount  of  tine  (1-c)  (v  ♦  pr(c)j“l  In  queue. 
Thus  the  expected  tine  spent  In  queue  because  of  service  Interuptlons  is 

(i-c)(~)t*lv  ♦  ur(c)J  1  .  If  1  >  c  ,  the  expected  Initial  wait  In  queue  until 

the  tagged  job  starts  service  Is  <l-c)(v  ♦  wr(c))"1  .  The  resulting  approxl- 
aatlon  to  the  expected  response  tine  is  (see  (2.4)) 


A"  2  'iTO)+  *  qi 

1-1  1 ’  l-c+1 


ct 

r(c) 


*  l-c+l  ,,“'C,‘V  *  "r(c,,’lfe  *  *] 


(6.2) 


Table  1  gives  values  for  the  expected  response  tine,  u(t)  ,  and  the  above 
approxlnetion  for  various  values  of  v,  v,  c,  and  t  for  r(J)  =  1  and 
If  -  25  tenslnals.  The  quality  of  the  approximation  (6.2)  appears  to  be 
excellent  for  all  cases  considered. 


(c)  Numerical  Implications. 


Aspects  of  the  behavior  of  a(t)  to  be  noted  fron  the  table  are  as 
follows.  If  the  amount  of  processing  time  required,  c  ,  is  "small",  then 
expected  response  time  is  minimized  when  c  is  maximized  (here  c  -  25) ;  that 
is,  when  there  is  maximal  processor  sharing  and  no  outside  queue.  If  t  is 
"large",  then  expected  response  time  is  minimized  when  c  -  1;  that  is,  when 
the  processor  is  dedicated  solely  to  the  job  that  is  being  served,  and  other 
jobs  queue  outside  in  turn.  Note  that  increasing  the  rate  of  service  Inter¬ 
ruptions  by  changing  v  can  either  increase  or  decrease  the  expected  response 
time,  depending  upon  job  time  requirements. 


These  behavioral  aspects  also  appear  by  taking  derivatives  of  the  approxi¬ 
mate  average  response  time  A  .  In  particular. 


If  r(J)  s  1 
increasing  in 


J 

c 


—  1, • • . ,N, 
“  ‘ » ;  . 


<  0 

if 

t  < 

i 

V  • 

-  0 

if 

t  - 

1 

V  ’ 

>  0 

if 

t  > 

1 

e 

n 

then 

and 

A  is  decresslng 

A  is  constant  in 

in 

c 

c  if  t  <  A  is 

if  t  -  i  . 
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rtully,  ir|UMBU  ilalUr  to  choc*  la  Section  3  will  show  that  the  re¬ 
sponse  tlae  la  approximately  normally  distributed  when  the  required  work  la 
large.  Again,  details  will  he  provided  la  later  work. 


i 
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APPHMPIX 


To  ehcw  (2.7)  and  (3.10)  yield  Che  aeae  value  for  B((R|W(t)  •  c)  for  c 
large  for  Che  cam  tij  ■  i»r(J)  . 


Writ: 


q(J> 


c*4u 


■  c 


n 

XQ*  ...  *  11_1 

•*1  *  •••  *  l*j_l 


■  s 


ji  Jot  'i 


.  c  j  >  *q  *  —  *  Vi 

j=l  r«>  "i  *  •••  *  “j-i 


Since, 


Pj  ■  vr(j) 


■  •  cu  J  3 
J-l 


(10  X  ...  x  1J_1) 
Mj  x  ...  X  (ij 


.  — 5K 


I 

n  J-i 

k-l  * 


HX0  * 


Vl> 


n 

l-j+i 


Further, 


."A 

k-l 


X  i-  x  ...  x  x  n 

j-l  0  3  1  k-j  11 


Hence, 


m 

1  JCAq  X  ...  X  X  .) 
1-1  3 

m 

n  Mk 
k«1+l 

X  J 

...  J-l  . 

fj-i 
n  x 
i-i  1 

* 

m 

n  w 
k-J+i 

[  x  ...  x  X,  .) 

J-l  °  3  1 

m 

n  “k 

lk-J  J 

m 

l 

J-i 

J-i 
n  x. 

[i-i 

n  “k 

U-j  J 

where  XjXXQ  -  1  by  convention. 
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Second: 


vbtrt 


A.  *  ...  *  X, 


m2V:,,  x  ^  W)w(o)  j-o.i,... 


»  \ 
k-2  * 


«  '(0)  - - g-«-  - 

•  • 

I  *  ...  *  .)  n  ji. 

J-i  1  J  1  k-i+i  ^ 


c  -  I  "*<j>  -  I 

J-0  J  x  J-l  J 


I  r(J)  -J— ; - jrp  *‘(0) 

J-l  w2  *•*  uj 


since 


.  •  A.  x  ...  x  X.  . 

v  l  ~rn — rir1  *'<o> 

V  J.A  Ji2  ...  * 


Hj+1  -  vr(J+l)  .  Thus 


A  comparison  of  5  with  a  shows  that 
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